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Abstract. - The first passage time (FPT) distribution for random walk in complex networks is 
calculated through an asymptotic analysis. For network with size N and short relaxation time 
T <C AT, the computed mean first passage time (MFPT), which is inverse of the decay rate of FPT 
distribution, is inversely proportional to the degree of the destination. These results are verified 
numerically for the paradigmatic networks with excellent agreement. We show that the range of 
validity of the analytical results covers networks that have short relaxation time and high mean 
degree, which turn out to be valid to many real networks. 
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Network is important in many areas of science and en- 
gineering as a mathematical representation of the interac- 
tion of complex real systems [1,2] such as the Internet, so- 
cial network, etc. Some of the common topological proper- 
ties for many real world networks, such as small- world and 
scale free properties [1], and fractal scaling [3,4] have been 
investigated. Recent research effort has begun to address 
the dynamical properties and critical phenomenon in com- 
plex network. Random walk problem, due to its simplicity, 
is therefore a key to the understanding of the propagation 
of dynamical quantities in network. The propagation of 
a random walker, which can represent the spreading of 
some signal in specific application, can be measured by 
the time needed to reach a selected node. In this regard, 
the first passage time (FPT) that measure the first time 
the random walker visits a given destination, is critical 
to many event triggered by the walker, such as epidemics 
spreading in social network [5], neuron firing dynamics [6] 
and various target search process [7,8]. Instead of the 
whole distribution, the mean first passage time (MFPT) 
is widely studied in different lattices with unbounded do- 
main [8], and bounded domain with arbitrary shape of 
boundary [9]. Although the general solution of MFPT 
has been found [10], the explicit relation between first pas- 
sage time and structural properties of network is still un- 
known. A recent work has related MFPT to the distance 
between source and destination [11] for fractal networks, 
which use the analysis of pseudo Green function for finite 
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lattice [9]. Nonetheless, it has been argued that this result 
should only be applicable to the deterministic fractal net- 
work with homogeneous degree distribution [12]. In com- 
parison with most deterministic fractal with fixed degree, 
real world networks typically have strong inhomogeneity 
in degree distribution. Thus, it suggests that the degree 
of nodes should play an essential role for the random walk 
in complex network and a treatment differently from the 
analysis of fractal network should be used. 

For many real world networks, the data are not suffi- 
cient for rigorous analysis. Hence, schemes to adjust the 
size of network have been proposed [3,13], but it is difficult 
to preserve structural properties without knowing the un- 
derlying construction mechanism. Computing the MFPT 
for networks with a particular property can therefore be 
useful for real world network. The pseudo Green function 
approach, which assumes a large domain, has difficulty in 
its application to real world networks that are small and 
have prominent boundary effects. 

In this paper, we will provide an analytical expression 
for the asymptotic first passage time distribution function, 
from which all moments, including the mean, can be com- 
puted and compared with numerical results for real and 
paradigmatic networks. We focus on the study of ran- 
dom walk in complex networks with short relaxation time 
irrespective of the type of network. In contrast to the 
pseudo Green function approach, our asymptotic analysis 
can also reveal the local dynamical properties around the 
destination. In particular, it allows us to compute a good 
approximation of the decay rate of FPT distribution and 
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Figure 1: Typical FPT distribution for a destination i;cz. At the 
long time scale t ^ FPT distribution decays exponentially. 
For the destination close to the source, the walker can reach the 
destination in a short time, resulting in a peak higher than the 
asymptotic curve. If the destination is far from the source, the 
walker has to visit many other nodes before the destination, 
resulting in a slow increase of FPT distribution. 



MFPT for networks with short relaxation time. We fur- 
ther argue that these expressions are approximate bounds 
for other general complex networks. Since most real world 
networks have short relaxation time, we find that our an- 
alytical calculation produces excellent comparison to nu- 
merical results on the MFPT for paradigmatic as well as 
real world networks. 

Formulation. — We consider a finite undirected net- 
work which consists of a set of nodes {^1,^2, •••,^Ar} that 
are connected by edges. The set of neighbors of a node v 
is denoted by Nei(v). Let V{v^t) be the probability of a 
random walker located at node at time step t. At each 
time step, the walker can move from the current node Vi to 
one of its nearest neighbor node Vj G Nei(vi), with equal 
probability 1/ki. Hence, the master equation of random 
walk is 



1)= E 

Vj GNei(^'i) 



(1) 



For the random walk problem in a finite domain, there is a 
characteristic relaxation time r such that equilibrium is es- 
sentially reached when t ^ r. We denote the equilibrium 
probability distribution by V^{v) for t ^ 00. By the prin- 
ciple of detailed balance, the net fiow of walker probability 
V^{vi)/ki —V^{vj)/kj is zero along each edge at equilib- 
rium. Hence, the equilibrium probability is proportional 
to the node degree V^{v) ex ky. After normalization, we 
get the Kac's result [9], V^iv) = ky/N (k), where (k) is 
the mean degree of network. Therefore, at equilibrium, 
the walker probability moving along each edge, in both 
directions, is equal to 1/N (k). 

Let J^{vdjt\vs) be the FPT distribution from a source 
node Vs to a destination node Vd that takes time t. By 
adding a sink at the destination, the FPT distribution 
can be found by computing the probability of the walker 
trapped at the sink. For a network with sink, we denote 
the probability that the walker is located at node v, at time 
t by yV{v,t). Note that W{v,t) is the analog of V{v,t), 
which addresses a network without sink. The FPT distri- 
bution for a sink at Vd can be computed by the following 



^J='{Vd,t\Vs) 







W(n,t-1) 



Vt > 

yveV- {vd} 



X/nGNei(v) ku 

W(n,t-1) 

(2) 

The first equation is the initial condition. The second 
equation is the absorbing boundary condition at the desti- 
nation. The third equation is the random walk transition 
probability corresponding to ([T]). These three equations 
define the random walk problem with a sink located at 
Vd- The last equation introduces the method to find the 
FPT distribution, which is given by the incoming proba- 
bility fiux fiowing towards the destination. Moreover, re- 
moval of the walker at the sink decreases the total walker 
probability, or the survival probability Wtotai {t) defined by 
y\^totai{t) = T.vev^i^^'^)' Hence, the FPT distribution 
and the total walker probability are related by 



J^{Vd,t\Vs) = Wtotalit - 1) - Wtotalit) 



(3) 



as the random walker is absorbed by the destination node 
at time t. 

Now, we perform asymptotic analysis of FPT distribu- 
tion. When t ^ r, the initial information of the source 
node is washed away, so walker probability decreases uni- 
formly for each node in the network. In this case, W{v, t) 
can be separated into two parts: 



t > T 



(4) 



where W{v) is a time independent probability distribu- 
tion that depends on network topology and the location 
of destination. By substituting Eq. Q back into the last 
equation in ([2]), we can get a structural factor jSd that 
depends on the destination node Vd'- 



f3d 



E 



Wiu) 



(5) 



and the asymptotic form of FPT distribution J^{vd^ t\vs) ~ 
(3dyVtotai{t — '^) for T. Solving this equation along with 
Eq. (||), we have Wtotai(t) - (1 - f3d)Wtotai{t - 1) and 
so yVtotai{'^) {1 — (3dY asymptotically. As we will show 
later, Pd is small, so that Wtotalit) oc exp [—^dt]- With the 
known asymptotic form of Wtotalit) j we can conclude that 
the FPT distribution is J='ivd,t\vs) ^ Aexp [-(3dt]. Thus, 
FPT distribution has an exponential tail with decay rate 
Pd cts shown in Fig. [l] In addition, we now know a method 
to compute decay rate analytically by Eq. ([5]), provided 
that Wiu) of all neighbors of destination Vd is known. 

Decay rate of FPT distribution. — After deriv- 
ing the exponential tail of the FPT distribution, our next 
task is to compute the decay rate /3d for the network with 
short relaxation time r such that r <C l/Pd- Physically, 
r represents the time to reach equilibrium in a network 
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Figure 2: For t ^ r, we show the deviation ^{u)/^^ (u) 
of the time independent probability distribution W(n) from 
the equilibrium distribution V°^{u) when there is no sink, as a 
function of (a) distance from destination Vd^ (b) degree of near- 
est neighbors u G Nei(i;d) which correspond to the distance=l 
in (a). The network used is the BA model with N = 10000 
and (k) = 10. 

without sink, and l/Pd is the approximate time scale for 
the decrease in total walker probability of the network 
when there is a sink to absorb the random walker. For 
network with short relaxation time, the removal of walker 
probability around the destination can be accomplished 
rather quickly. On the other hand, the total probabil- 
ity decreases with a much slower rate and this result in 
a quasi-equilibrium state. This physical picture implies 
that the quantity W{u) = limt^^- t)/Wtotaz(^) is ap- 
proximately equal to V^{u). This can be observed for 
the Erds-Rnyi (ER) network and Barabsi-Albert (BA) 
network which have very short relaxation time (see Ta- 
ble [T]). One of them is illustrated numerically in Fig. 
|2^. In the simplest case, it is reasonable to assume that 
W{u) = V^iu) for d{u,Vd) > 1. While this assump- 
tion is substituted back to Eq. ([5|, the decay rate is 
Pd = kd/N (k). It scales linear with the degree of des- 
tination and scales inversely with the size of the network. 
Thus, for a large network, /3d can be very small. 

Next, we proceed to a better approximation for the de- 
pendence of yV{u) on the ku around the destination. For a 
nearest neighbor u of the destination, W{u) have to take 
a smaller value than V^{u) to compensate the fiow of 
walker toward the sink. Hence, it is natural to expect that 
W{u) < V^iu). Rather than assuming W{u) = V^iu) 
for nodes other than destination, a refined assumption can 
be made for the next nearest neighbors: 

W{u,t)=V^{u)Wtotai{t), d{u,Vd) > 2 (6) 

With this assumption, W{u) for u G Nei('U(i) has to be 
found before computing the decay rate. Here, nodes with 
distance two from the destination are treated as the reser- 
voir of walker probability. We thus assume that each edge 
of node v, that are of distance greater than 1 away from the 
destination, diy^Vd) > 2, has probability 1/N {k) moving 
out at each time step. 

Now, let us focus on a nearest neighbor node u of the 
destination. Since there is no probability fiowing from Vd 
to ix, therefore, only /c^ — 1 neighbors of u have probability 




Figure 3: (color online) MFPT vs degree of destination kd for 
the (a) ER and (b) BA model, with N = 10000. The points are 
simulation result and the lines are the theoretical prediction. 

fiowing into u. If there are no edges connecting between 
neighbors of Vd^ i.e., assuming zero clustering coefiicient 
of Vd^ then each edge contributes 1/N (k) to u from the 
second neighbor of Vdj or W('u) = {ku — 1) /N (k). If there 
are some edges connecting neighbors of Vdj i.e., for the case 
of non-zero clustering coefiicient, then some neighbors of u 
are also neighbors of Vd- In this case, nodes in Nei('Uc/) have 
value less than and the probability moving out has 
value less than or equal to 1/N (k). The exact value can be 
found by solving W{u) for all u G Nei('y(i) simultaneously 
and it is upper bounded by 

W{u) < (^^) r^iu), d{u, Vd) = 1 (7) 

As shown in Fig. ^ for the BA model, this result fits 
well with the simulation of W{u) and the equality sign 
hold approximately. In general, this upper bound can be 
reached for networks with very short relaxation time. Now 
we put Eq. Q into Eq. ^ to get 

\ nGNei(vd) / 

where the last term is the mean of inverse degree of neigh- 
bor that can be approximated by mean field. Let's recall 
that the probability of selecting one of nearest neighbors 
with degree k for uncorrelated network is P{k)k/ (k) [14], 
where P{k) is the degree distribution of the network. 
Similar to the computation of mean degree of neighbor 
in Ref. [15], the mean of inverse degree of neighbor is 
f^{P{k)k/{k))ldk=^, so 

which suggests that the actual decay rate obtained in sim- 
ulation is slower than this upper bound. Note that this 
result is consistent with our basic hypothesis r <C l//3d 
if r <C A/". We find that this theoretical decay rate is in 
excellent agreement with the simulation result for the ER 
and BA network (see Table [T]). 
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Mean first passage time. — Since FPT distri- 
bution is normalized for a finite undirected network, 
J^{vd^t\vs)dt = 1, it can be spHt asymptotically as 
the sum of short time scale and long time scale as: 



rc poo 

J J='{vd,t\vs)dt^ J Ae-^^^dt' 



c^r (10) 



where c is a cutoff value. In a finite domain, FPT dis- 
tribution always rise from at t = and decreases with 
exponential tail [8] when t ^ oo (see Fig. [T]). For a 
destination node far from the source node, J^{V(i^t\vs) is 
bounded above by Ae~^'^^ within < t < c. Hence, for 
short relaxation time r <C c <C l/Pdj the first term is 
bounded by Ae~^'^^dt ~ which contributes negligibly 
small value to the sum. By extending the domain from c 
to for the dominant second term, we obtain A ^ /3d hj 
computing Ae~^'^^dt ~ 1. Similar analysis can be per- 
formed for MFPT (T) = tJ^{vd,t\vs)dt and the result 
is (T) ~ l/Pd' Using the decay rate derived in Eq. ([9|, 
the MFPT is given by 



N{k) 
kd 



{ky 



(11) 



which is a lower bound for the MFPT. We can get a similar 
approximate result for {T{kd)) of MFPT averaged over all 
node pairs with same destination degree because this aver- 
age is dominated by nodes separated far away. Networks 
with short relaxation time r <^ N such as the ER and 
BA model have diameter of order 0{lnN) and the num- 
ber of nodes grow exponential as the distance increase. So 
the MFPT is dominated by the nodes with separation of 
order 0{\nN). We see excellent agreement of our theory 
with numerical results for the ER and BA networks in 
Fig. [sj However, for networks with fractal scaling [3], the 
diameter scales as 0{N^) for some a, so that more de- 
tails about the structure are required to compute MFPT. 
Hence, we do not expect our result is good when applied 
to those fractal networks. Note that Eq. (11) is compat- 



ible with a previous numerical result [16] suggesting that 
{T{kd)) cx l/kdj in which we have also computed the ex- 
plicit form and shown that it is the lower bound of MFPT 
of networks with short relaxation time. With the method 
we used, higher moments of FPT distribution can also 
be computed as {T^{kd)) ^ niP'^^. Note also that our 
derivation depends on the property of short relaxation 
time regardless of the size of network. In addition, the 
mean first passage time {T)q of the whole network G can 
be computed by taking weighted average over the degree 
distribution as (T)^ = P{k) {T{k)). Since P{k) 
as /c ^ oo and {T{k)) cx 1/k for the networks considered 
in this paper, we have {T)q cx N {k) which grows linear 
in the network size and corresponds to the network with 
compact exploration [11]. 

Real world networks. — We now test the applica- 
bility of our theory to real world networks which may 
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Figure 4: MFPT vs degree of destination kd for real world net- 
works. The circles represent simulation result and the curves 
represent computed MFPT. 



have long relaxation time and structural inhomogeneity. 
The networks we examined are the Coauthorship network 
(astro-ph, cond-mat, hep-th) [17], C. Elegans neural net- 
work [19], E. Coli. Metabolic network [20], Yeast protein 
interaction [21] and United States Power Grid [22]. In the 
simulation, only the largest connected component of each 
undirected network is considered. 

The random walk properties and MFPT for different 
networks are presented in Table [l] and Fig. [ij The relax- 
ation time r is computed by r = — 1/ ln(|A2|), where A2 is 
the second largest eigenvalu^of the time evolution oper- 
ator Eq. ([1]), or the random walk matrix after similarity 
transformation (see [23]). As shown in the table, the decay 
rate for the real world networks has the same order of mag- 
nitude as the theoretical value and is bounded below by 
our predicted upper bound. Moreover, for most networks, 
the relaxation time r and the inverse of decay rate 1/ {(S^) 
can differ by one to two order of magnitude which suggests 
that the relaxation time is short. For Power Grid, due to 
the small difference between r and 1/ our theory does 
not apply to this case as shown in the poor match of the 
decay rate between numerical and theoretical values. 

Furthermore, for most networks except Power Grid, we 
have r <C iV. This condition results in a good averaging 
effect on the MFPT as shown in the Fig. [4| To relate 

^E. Coli. metabolic network is a bipartite network that has no 
odd loops, so its second largest eigenvalue is -1 which corresponding 
to a state oscihating between two different partitions. Neverthe- 
less, the equilibrium for odd and even time series can be reached 
separately and the first passage time is still well defined. Instead, 
the third eigenvalue A3 can be used to represent the approximate 
relaxation time to reach the oscillating state. 
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Table 1: Random walk properties of different paradigmatic and real world networks, with size mean degree (/c), relaxation 
time r, simulation decay rate P2 ^tnd theoretical decay rate Pd given by Eq. 
and the P2 can be found numerically after a long run by using Eq. 



(|9|. The method to compute r is described in text 
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n QQ 


RA model 


10000 


8 


2.3 


11624 


0.99 


BA model 


10000 


4 


5.6 


10985 


0.98 


Coauthorship network, astro-ph [17, 18] 


14845 


16.1 


304 


18435 


0.76 


C. Elegans neural network [19] 


297 


14.5 


4.6 


323 


1.00 


Coauthorship network, cond-mat [17, 18] 


13861 


6.4 


139 


23601 


0.67 


E. CoH. MetaboHc network [20] 


2268 


5.0 


(16) 


3398 


0.80 


Coauthorship network, hep-th [17, 18] 


5835 


4.7 


179 


10955 


0.78 


Yeast protein interaction [21] 


1458 


2.7 


120 


3398 


0.89 


United States Power Grid [22] 


4941 


2.7 


3689 


30008 


0.34 



the relaxation time to structural properties of network, 
we note that network with high mean degree are close to 
our theoretical lower bound. For network with very high 
mean degree, say (k) ^ N, the equilibrium can be reached 
almost instantaneously because all nodes are neighbors to 
each other. Also, real world networks usually have ran- 
dom links between nodes, so the higher the mean degree, 
the closer it resembles to random network which is well 
described by our theory. Hence, our theory should work 
well for real world networks with high mean degree. In 
comparison, network with low mean degree, say (/c) ^ 2, 
is similar to a tree structure. In this case, the separation 
between nodes are large and the walker need more time 
to visit each node, so a longer relaxation time is required 
to reach equilibrium. As a result, deviation from our the- 
oretical low bound is larger. In this situation, description 
of the first passage time using the distance between source 
and destination is more appropriate. 

Summary and discussion . — In conclusion, our 
asymptotic analysis of FPT distribution allows us to com- 
puted an accurate expression of the decay rate of FPT 
distribution (|9| for networks with short relaxation time 
r <C l/Pd- We have also shown that the decay rate of 
real world networks has similar order of magnitude as 
T^^i^d) = kd/N (k) and is upper bounded by this value. 
This upper bound can be explained by a physical picture 
that local neighbors around the destination, at the quasi- 
equilibrium state, should take the walker probability less 



it predicts the MFPT to be 



than V^{u). Moreover, we have computed the MFPT ( 11 ) 



for destination far from the source. A similar expression of 
MFPT that depends on destination degree is argued to be 
correct for network with r <^ N. These theoretical results 
on the relationship between MFPT and destination de- 
gree have been verified by numerical simulations on both 
paradigmatic and real world networks. Our analysis can 
also be readily extended to other variants of random walk 
problem, such as random walk in weighted networks and 
biased random walk [24], with short relaxation time and 



V^{k) 



(12) 



where V^{k) is the equilibrium probability for the corre- 
sponding random walk problem. 

Since 1/ Pd also scales linearly in A/", the condition for 
networks with short relaxation time then becomes r <^ N. 
Assuming that this condition of short relaxation time is 
met, we have shown numerically that the relaxation times 
of many real world networks are actually short. Therefore, 
our analytical results are actually applicable to these real 
networks. We also argued that real networks with high 
mean degree should have short relaxation time. 

Finally, we should note that although paradigmatic net- 
works with random global links, such as the ER and BA 
network, show extremely short relaxation time [25] and 
our theory fits very well with the numerical data on these 
networks, we expect more complex dynamical properties 
from real networks, which deserve further study. 
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